n SERVICE METRICS-I ^ 

— o 

IN THE UNITED STATES 
o PATENT AND TRADEMARK OFFICE 

PATENT APPLICATION 

<»c=> 

a 

CASE: SERVICE METRICS ^ 


TITLE:A METHOD AND SYSTEM FOR INTERNET PERFORMANCE MONITORING AND ANALYSIS 


THE COMMISSIONER OF PATENTS AND TRADEMARKS 
WASHINGTON, D.C. 20231 

SIR: 


Enclosed are the following papers relating to the above-named application for patent: 

Specification pages) and 1 coversheet 
Drawing(s) (8 sheets) 
Express Mail EE486710765US 
1 Post Card 


CLAIMS AS FILED 


NO. FILED 

NO. EXTRA 

RATE 

CALCULATIONS 

Total Claims 

22 

0 

x$9 

$00.00 

Independent Claims 

3 

0 

X$39 

$0.00 

Multiple Dependent Claim(s), if applicable 

x$270 

$.00 

Basic Fee 


$345.00 


TOTAL FEE: $ 


Please address all correspondence to Intellectual Property Docket Administrator, Gibbons, Del Deo, 
Dolan, Griffinger & Vecchione, One Riverfront Plaza, Newark, New Jersey 07102-5497, However, all 
telephone calls should be made to Donald J. Cox, Jr. at (973) 596-4853, or (973) 596-4500. 



Donald J. Cox,^ 
Reg. No. 37,804 
Attorneys for Applicants 



Date: June 23, 2000 
Gibbons, Del Deo, Dolan, 
Griffinger & Vecchione 
One Riverfront Plaza 
Newark, New Jersey 07102-5497 


#264997 vl 
100456-33751 


EXPRESS MAE. NO.: EE486710765US 


Service Metrics-I 


UNITED STATES PATENT AND TRADEMARK OFFICE 

APPLICATION 
FOR 


A METHOD AND SYSTEM FOR INTERNET PERFORMANCE MONITORING AND 

ANALYSIS 


Inventors: 

Niel Robertson 
701 Pearl Street, No. 3 
Boulder, Colorado 80302 
Citizenship: U.S. A. 

Chris Burton 
2728 Bristlecone Court 
Lafayette, Colorado 80026 
Citizenship: U.S.A. 


EXPRESS MAIL NO. : EE4867 10765US Service Metrics - 1 

CROSS REFERENCE TO RELATED APPLICATION(S) 

This application claims the benefit of U.S. Provisional Application No, 
06/140,542 filed June 23, 1999, which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

5 1. Field Of The Invention 

This invention relates to communication systems having remotely readable digital 
documents, and more particularly to the performance of conmiunication systems having 
remotely readable digital documents. 

2. Description Of The Related Art 

10 Because the Internet evolved from the ARPAnet, a research experiment that 

supported the exchange of data between government contractors and (often academic) 
researchers, an on-line culture developed that is alien to the corporate business world. 
Although the Internet was not designed to make commercialization easy, Intemet 
publishing and e-commerce have rapidly evolved. In part it is the very ease that anyone 

15 can pubUsh a document that is accessible by a large number of people that makes 

electronic publishing attractive. Setting up e-commerce provides low overhead while 
reaching a worldwide market 24 hours a day. The growth and popularity of the Intemet is 
providing new opportunities for conmiercialization including but not linndted to Web sites 
driven by electronic commerce, ad revenue, branding, database transactions, and 

20 intranet/extranet applications. 
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Transaction Control Protocol/Internet Protocol (TCP/DP) is the communications 
standard between hosts on the Internet. TCP/IP defines the basic format of the digital 
data packets on the Internet allowing programs to exchange information with other hosts 
on the Internet. 

Domain names direct where e-mail is sent, files are found, and computer 
resources are located. They are used when accessing information on the World Wide 
Web (Web) or connecting to other computers through Telnet. Internet users enter the 
domain name, which is automatically converted to the Internet Protocol address by the 
Domain Name System (DNS). The DNS is a service provided by TCP/IP that translates 
the symbolic name into an IP address by looking up the domain name in a database. 

E-mail was one of the first services developed on the Internet. Today, e-mail is an 
important service on any computer network, not just the Internet. E-mail involves 
sending a message from one computer account to another computer account. E-mail is 
used to send textual information as well as files, including graphic files, executable file, 
word processing and other files. E-mail is becoming a popular way to conduct business 
over long distances. Using e-mail to contact a business associate can be faster than using 
a voice telephone, because the recipient can read it at a convenient time, and the sender 
can include as much information as needed to explain the situation. 

In 1989, researchers at CERN wanted to provide a better method for widely 
dispersed groups of researchers to share information. The researchers needed a system 
that would enable them to quickly access all types of information with a common 
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interface. By the end of 1990, researchers at CERN had a textual browser and a graphical 
browser developed. 

A browser is an application that knows how to interpret and display hypertext 
documents that are located on the Web. Hypertext documents contain commands, 
5 references and links to other text and documents. This allows a reader to quickly access 
related text. In addition to text, many documents contain graphics, audio and animation. 

HTTP (HyperText Transfer Protocol) is an application-level protocol for 
distributed, collaborative, hypermedia information systems. It is a generic, stateless, 
object-oriented protocol which can be used for many tasks, such as name servers and 

10 distributed object management systems, through extension of its request methods 
(commands). A feature of HTTP is the typing and negotiation of data representation, 
allowing systems to be built independently of the data being transferred. HTTP is 
described in a working document of the Internet Engineering Task Force (IETF), entitled 
"Hypertext Transfer Protocol -- HTTP/1.1" dated November 22, 1995, which is 

15 incorporated herein by reference. 

Hypertext Markup Language (HTML) is an authoring software language used to 
create Web pages. HTML is basically ASCII text surrounded by HTML commands in 
angle brackets, which are then interpreted by a browser. Standard Generalized Markup 
Language (SGML) is a text-based language for describing the content and structure of 

20 digital documents. SGML documents are viewed with transformers, which render SGML 
data the way Web browsers render HTML data. Extensible Markup Language, is a pared- 
down version of SGML, designed especially for Web documents. It enables designers to 
create their own customized tags to provide functionality not available with HTML. 
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A Uniform Resource Locators (URLs) is a pointer or link to a location. The URL 
contains a transmission protocol, such as HyperText Transfer Protocol (HTTP), a domain 
name of the target computer system, a page identifier and a bookmark. 

Commercialization of the Internet has been made possible largely through the 
development of the wide spread use of web pages in which file containing text, graphics, 
sound and video media are combined and displayed to the user as an integrated document. 
The combination of these files often requires that accessing files that may be stored on 
multiple servers that are owned and operated by different companies and are located at 
geographically separate locations. To the end user accessing the web page, the files are 
combined to form an integrated media presentation. 

However, bottlenecks and traffic jams on the Internet reduce overall system 
performance and have a direct negative impact on commerciaUzation. Accordingly, there 
is a need to provide businesses with an accurate, objective measurement of Web site 
performance from the end user's point of view. Thus, the need exists for a way to provide 
web site developers with information relating to the way in which the files that make up 
the web page are transmitted to the end user. 

SUMMARY OF THE INVENTION 

The present invention is a method for internet performance monitoring and 
analysis comprising the steps of collecting object-level data of remotely readable 
documents, and measuring access parameters to the object-level data, during the 
collection process. 
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A system for carrying out this method includes at least one agent connected to a 
computer network and adapted to collect the object-level data and to measure the access 
parameters while the collection of the object-level data occurs. 

In another aspect of the present invention, an embodiment of the present invention 
includes a plurality of agents located at distributed points throughout a global computer 
network. Each agent is adapted to collect the object level data and to measure access 
parameters while the collection of the object-level data occurs. The collective 
measurements when taken at different points throughout the network provide functional 
tools to assess the distribution of the remotely readable documents. 
BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the present invention may be obtained from 
consideration of the following description in conjunction with the drawings in which: 

FIG, 1 is a block diagram of interconnected computer system networks employing 
the present invention; 

FIGS. 2-7 are diagrams of screen displays illustrating information measured and 
reported by the present invention; and 

FIG. 8 is a block diagram of data collection agents distributed throughout the 
interconnected computer system networks according to the present invention. 

DETAILED DESCRIPTION OF VARIOUS ILLUSTRATIVE EMBODIMENTS 

Although the present invention, a method and system for measuring and analyzing 
performance of a remotely readable document, is particularly well suited for use in 
connecting Internet users and shall be so described, the present invention is equally well 
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suited for use in other network communication systems such as an Intranet. The term 
remotely readable document provides a general description of documents which includes 
HTML documents commonly referred to as web pages, but is not intended to be limited 
to the HTML standard. Similarly, the use of the term web page used in describing the 
preferred embodiments is provided as a common term to facihtate understanding of the 
invention; however, the preferred embodiments are not intended to be Umited to the 
HTML format and should be interpreted broadly to refer to the transfer of information in 
any format. Furthermore, the term browser, a generic reference to a computer application 
for downloading and displaying remote documents under the HTTP, is used in describing 
the preferred embodiments to facilitate understanding of the invention; but the preferred 
embodiments should be interpreted to refer to appUcations for downloading and 
displaying remote documents under any transfer protocol standard. 

Referring to FIG. 1 there is shown an overview of interconnected computer 
system networks. Each computer system network 10 and 12 contains a local computer 
processor unit 14 that is coupled to a local data storage unit 16. The local computer 
processor unit 14 is selectively coupled to a plurality of users 18 through the Internet 20. 

A user 18 locates and clicks on to a particular Web page, the content of which is 
located on the local data storage unit 16 of the computer system network 10, to access the 
content of the Web page. The Web page may contain links to other computer systems 
and other Web pages. Advantageously, the present invention provides network 
performance measurements from an end-user's perspective in which the download time of 
the files that makes up the web page is measured. By utiUzing this measurement of Web 
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site performance, businesses are able to pinpoint and solve critical performance issues. 
Moreover, the present invention provides for the performance measurements to occur at 
different geographic locations, between different proprietary systems and on different 
hardware platforms across the Internet. 

The speed and performance of downloading Web pages is complex and depends 
on many variables, the Web site itself, the internet service providers, the backbone 
network companies and the end-user configurations. Many different factors can 
contribute to poor performance. Design problems, system outages, hardware and software 
failures, and overloads, can occur in all the major components that make up the 
connection from end-user to Web server. Performance measurements can help identify 
when the problem occurred, the cause of the problem. Examples of problems by major 
category are: end-user, ISP; backbone providers; web site-servers; and web page content. 

End-User - Slow access speed, browser incompatibilities, and system 
configuration problems. 

ISP (Internet Service Provider) - Poor DNS architecture, server network 
congestion, inadequate peering arrangements, feature overload. 

Backbone Providers - Congestion due to under provisioning facilities or routers, 
hardware failures, poor performance under traffic overload. 

Web Site Servers - Servers and local network under engineered, poor load 
balancing, poor caching strategies, overloads from ad banners or content from off site 
servers. 

Web Page Content - Audio or visual objects too time consuming, design problems 
in handling transactions. 
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Being able to tell where the faults and delays occurred, determining avenues of 
correction, and verifying the success of those changes are advantages obtained from 
measuring Web site performance. 

The present invention provides a real-time performance monitoring system 
comprising a user interface component and a performance-monitoring component. 
Information about the transfer of files making a web page is collected by the 
performance-monitoring component and transmitted to the user interface component. 

The user interface is concerned with displaying performance data to a user in a 
way that helps the user understand how well a web server or servers have satisfied an end 
user's request to download a web page. Since the web page is a number content files 
such as HTML text, scripts, graphics, sound that needs to be individually downloaded to a 
user's browser, these components may come from different servers having unique 
performance characteristics and located at different places in the vast Internet topology. 
The user interface portion provides a display of the timing for a sample download of the 
different component files of a single web page, showing the relative timelines of each 
component as it is downloaded. 

The system measures all data elements required to accurately represent the end- 
user experience and provide the information necessary to achieve optimal Web site 
performance and effectively manage vendors. Data elements measured and reported by 
the user interface include: 

DNS Lookup Time - the average time required to translate a host name into an IP 

address, which the browser needs to communicate with the Web server. 
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Connection Time - the average time it takes to establish a connection to the Web 
server across the network. This includes the construction of the TCP/IP 
connection and all the associated "handshaking" that occurs within the process. 
Request Time - the average time it takes to send the URL request (and associated 
HTTP request headers) to the connected Web server. 

Response Time - the average time it takes for the Web server to start responding 
with content. 

Connection Teardown Time - the time it takes to tear down the socket connection 
(the equivalent of saying goodbye and hanging up the phone) between the cUent 
and the server. 

End-To-End Time - the overall time it takes from when the first DNS request is 
made until the last byte of the last object comes back. This is equivalent to 
clicking on a link in your browser and waiting for the browser to say, "document 
done" at the bottom. 

Size of Content - the total size of all content on a Web page (associated images 
and other objects). 

Throughput - measures, in bytes/second, how quickly data was transferred from 
the server to the user's browser. 

Object Counts - the number and types of objects per hour included on a page. 

The present invention method and system for Internet performance monitoring 
and analysis is accessed from a primary menu. For a particular URL the Status page is 
used to view the Web Performance Timeline page for that URL. The Web Performance 
Timehne is a tool designed to measure Web site performance. The Web Performance 

10 
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Time Line allows a Web site engineer to objectively examine the experience of 
transferring a Web page from a server to a browser and examine that Web page's 
performance from the end-user perspective. Additionally, the Web Performance Time 
Line allows a Web site engineer to objectively trace the transfer of a Web page on a 
5 server to a browser and examine the performance of the network and the various servers 
in response to a Web page download request, from the user's perspective. The Web 
Performance Time Line measures every object on a Web page and shows what the object 
is, where it originated, and what the performance characteristics of the object were, in 
real-time. Web pages are constructed of many different types of objects: text files, 

10 graphics, Java applets, sound files, etc. These objects may have completely different 
performance characteristics. They may originate from different sources. Web sites often 
have multiple Web servers that provide the objects that are combined to create an Web 
page. A common example is an ad banner that is served from an ad network. In order for 
a completed Web page to come back to the end-user in a timely fashion, not only must the 

15 main Web site's servers work correctly, but the ad network's servers must work efficiently 
as well. If one of these object serving components malfunctions or performs inefficiently, 
the end-users may experience a slowly-loading or incomplete web page. There are four 
main sections of the Web Performance Timeline screen: Object View with access to the 
Stats View Window; Timeline Legend; Web Page Server Summary; and URL 

20 Configuration . 

Referring to Fig. 2, there is shown the Object View at the top of the Web 
Performance Timeline page. It has the following components URL 10, Agent 12, timing 

11 
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tick marks 14, object performance characteristic rows 16, summary footer 18, and Icon 
columns 20. 

The URL 10 shows which page/URL you are measuring. The Agent 12 shows 
which DCA (Data Collection Agent) you are utilizing for your evaluation. 

The timeline to be scaled horizontally by the total download time for the page 
being measured. At the top of the Object View timeline table there is a row of timing tick 
marks 14. The large ticks mark seconds. Each small tick mark is one 10th of a second. 
The timing tick marks 14 are scaled across the timeline dynamically, based on the total 
download time for the page. 

The object performance characteristic rows 16 include for each object on the Web 
page causes a new row to be created in the Object View timeline table. When each object 
is downloaded, the browser goes through a specific process: 

1. Resolve DNS for the hostname of the object (might already be cached) 

2. Connect to the server 

3. Request the object 

4. Wait for the response 

5. Download the data 

6. Disconnect from the server 

Each step is segmented by color on the horizontal row for an object. View the 
Timeline Legend to reference a color to its corresponding event in the download timeline 
for an object. The six download events are measured sequentially for each object. The 
corresponding event color bars are displayed horizontally to create a download timeline 
row for the object. Look at the download timeline for an object to see approximately how 

12 
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long it took to download the complete object. The relative proportions for each event of 
the download process can also be seen. 

If the mouse is moved over a colored bar, two things will happen: 

• A tool tip will pop up (in 4.x version of the browsers) showing the full 
URL for the specific object. This allows you to see what object the bars 
denote. 

• The status line at the bottom of the browser window will also tell you what 
object you are looking at. 

If you click on one of the colored bars in an object's timehne, the statistics for that 
object will be put into the floating Stats View window. The Stats window shows the 
exact times for each download step (in seconds), as well as the total download time for 
the object, its size, the HTTP status code, IP address, type and if it was generated by a 
secure server. 

The Summary footer 18 of the Object View summarizes the data collected for the 
Web page you are measuring. The Summary footer 18 includes: total time; total size; 
total objects; and view stats. Total time is the end-to-end time (in seconds) for the page 
download, from the start of the first object to the end of the last object. Total size is the 
sum of all the object sizes on the page (in bytes). Total objects is the total number of 
objects contained in the page. (Each row in the Object View timeline table is a separate 
object.) View stats displays the floating Stats View Window. 

Icon columns 20 are three columns preceding every object's performance 
information. 1st icon colunm - Indicates whether the object was generated by a secure 

13 
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server. If it was, the secure icon 30 (shown in Fig. 3) would appear in the first column, 
otherwise this colunnn is blank. 2nd icon column - Denotes whether or not the object 
came from the original server. Each object measured is checked against the hostname 
shown in the URL Header. If the hostname matches, no icon is put into the column. If it 
differs, the off site icon 32 (shown in Fig. 3) is displayed to indicate that the object came 
from a different server than the one targeted, such as an ad or image server. 3rd icon 
column - has an icon which denotes what type of object that row is charting. Object 
types include: redirect; image; text/HTML; and Java/Script/other. Redirect is an HTTP 
redirection that tells the browser to look elsewhere for an object (very common when 
serving ads or load balancing across multiple servers). This is represented by the redirect 
icon 34 (shown in Fig. 3), Image is an image file or graphic (gif, jpeg). This is 
represented by the image icon 36 (shown in Fig. 3). Text/HTML is an HTML page or a 
frame that is part of a frameset. This is represented by the Text/HTML icon 38 (shown in 
Fig. 3). Java/Script/Other is anything else not listed above. Most often this denotes a Java 
applet that needed to be downloaded or a javascript include, but could also indicate an 
audio or video file. This is represented by the Java/Script/Other icon 40 (shown in Fig. 3). 

Object Features to take particular notice of include parallehzation and 
parsing/downloading. Parallelization is when some objects in the Object View are 
collected in parallel. Object rows of colored bars that overlap on the timeline horizontal 
axis were being collected in parallel. This is a normal web browser operation. Once an 
HTML page is loaded, the browser may know about a number of images that need to be 
downloaded. It will request those objects in parallel from the server in the hopes of 
decreasing the total time to download the page. The default setting of Netscape is to 

14 
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download 4 objects in parallel. Parsing and downloading is when the downloading of 
referenced objects does not depend on the complete HTML object file content to be 
downloaded first. As content is received in the browser, it is being parsed. As soon as a 
fully qualified reference to an object is encountered, the data file for that object will be 
requested. Therefore, objects are seen as being requested and downloaded while the 
HTML object file is still in the "download" stage. 

Click on the View Stats button 22 (shown in Fig. 2) in the Web Performance 
Timeline page Summary footer. 

Referring to Fig. 4, the Stats View window 40 shows the statistics for the most 
recently selected (clicked on) object in the Object View timeline. Times shown in the 
Stats View window are in seconds. OBJECT URL 42 is the complete URL of the most 
recently selected (clicked on) object. IP Address 44 is the specific IP address that was 
used to get the object. Since a hostname may resolve to multiple IP addresses, the one we 
use is tracked in case one IP in a server farm breaks. Type 46 is the MIME type of the 
object. It correlates to the icon you would see in the third icon column in the Object 
View. Secure 48 denotes whether or not the object was generated by a secure server. 
DNS Time - The time it took to resolve the DNS for the hostname of the URL. If the 
DNS was previously resolved on this page, it will be cached and the value will be Usted 
as "cached" (in seconds). Connection Time 50 is the time to connect to the server across 
the network (in seconds). Request Time 58 is the time to send the HTTP request to the 
server (in seconds). Response Time 52 is the time for the server to respond with the first 
byte of content. Download Time 56 is the time for the object to be fully transferred from 


15 
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the server to the browser. Disconnect Time 60 is the time for the network connection to 
be closed (in seconds). Total Time 62 is the sum of the DNS, Connect, Request, 
Response, Download, and Disconnect times (in seconds). Bytes 64 is the total size of the 
object, including headers (in bytes). Status 66 is the HTTP status code which 
5 corresponds to: Ixx Informational; 2xx Successful; 3xx Redirection; 4xx Ghent Error; 
and 5xx Server Error. 

Referring to Fig. 5 there can be seen the Timeline Legend section 70 of the Web 
Performance Time Line which explains the colors 72 and icons 74 used in Object View. 
Each object that is presented in the Object View has a set of icons associated with it, 

10 explaining what type of object it is, and associated properties. Additionally, colored bars 
for each event segment represent each object's performance characteristics. The colors of 
the bars that represent measured events for the timeline in the Object View are hsted in 
the Timeline Legend, 

Referring to Fig. 6 there can be seen the Web Page Server Sunmiary section 80 of 

15 the Web Performance Time Line that decomposes all the servers that went into creating 
the page. Several servers may be responsible for creating one page. One inefficient server 
can significantly impact the overall performance of the page. The servers that contribute 
content may be run and managed by parties other than that of the web site owner. 
For each server involved data is listed. This data includes: Overview 82; 

20 Hostname and IP Address 84; objects 86; images 88; files 90; Java/Script/Other 92; 
redirects 94; total size 96; average DNS 98; average connect 100; average request 102; 
average response 104; average download 106; and average disconnect 108. 


16 
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Overview 82 indicates the number of servers contacted. Hostname and IP 
Address 84 is the specific hostname and IP address used to determine which server to 
contact. Note that a hostname may map to multiple IP addresses so it may be valuable to 
see which actual machine behind a hostname served up the objects. Objects 86 are the 
5 total number of objects served from this server. Objects is basically the number of times 
that the server needed to be contacted to collect its content for the page. Images 88 are 
the number of images transferred by the server. Files 90 are the number of text based 
files (HTML, frames, plain text) transferred by the server. Java/Script/Other 92 are any 
other objects (excluding images and text files) transferred by the server, usually java 
'2 10 applets or javascript includes, but may be other items such as background audio files, 
i3 Redirects 94 are the number of redirects issued by the server. Total Size 96 is the total 

1-^ number of bytes transferred from this server. The number of bytes served includes all 

HTTP headers returned in addition to the page content. Average DNS 98 is the average 
tiine (across multiple looks) that it took to resolve the DNS for this hostname. If the 
y 15 server is referenced by IP address only, this will either be denoted as "0" or "possibly 
O cached". Average Connection 100 is the average time in seconds it took to connect to 

the server, (The TCP/IP connection time between the browser and server.) Average 
Request 102 is the average time in seconds it took to send HTTP requests to the server. 
Average Response 104 is the average time it took for the server to respond with the first 
20 byte of content. Note that we are very specific in our meaning of "the first byte of 

content". This is very different than the first byte returned. For non-flat file objects, there 
are two ways dynamic data can be returned: 

17 
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• Header, <processing>, content 

• <processing>. Header, content 

If the Web Performance Time Line just measured the time to get the first byte 
back, servers and CGI/dynamically served pages which send the header back 
5 instantaneously would cause the Web Performance Time Line to erroneously report the 
time it took to process the request and respond. By waiting for the first byte of content to 
come back, the Web Performance Time Line can effectively normalize over these two 
options and best capture back-end processing time for a request. 

Average Download 106 is the average time in seconds it took to download all the 
10 data for the object. Average Disconnect 108 is the average time in seconds it took to 
disconnect the TCP/IP connection between the browser and server. 

The URL Configuration section displays the agent parameters used in the 


measurement process. 



1. 

-- URL DESCRIPTION -- The URL target for measurement. 

15 

2. 

- USER AGENT - 


3. 

- DOWNLOAD FRAMES - 


4. 

-- DOWNLOAD IMAGES -- 


5. 

- ALLOW REDIRECTS - 


6. 

-- USE PROXY AUTH - 

20 

7. 

-USEWEB AUTH- 


8. 

-- USE COOKIES - 


9. 

-- KEEP NEW COOKIE - 


10. 

- PROXY USER NAME - 
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11. - POST DATA - 

12, - COOKIE DATA - 

The second component of the system actually takes the measurements and 
provides the measurement data needed by the user interface to report the performance 
5 characteristics. The measurement collection component comprises at least one Data 
Collection Agent (DCA). A DCA is a computer operating on a network and configured 
with software that is controlled remotely from another location on the network to locate a 
particular web page using the URL of the web page and to download the files that make 
up the web page using HTTP during which the time required to download each file is 

10 measured, recorded and transmitted back to the remote location that requested the 

download. Preferably, multiple DCAs are placed strategically throughout the Internet that 
act as web browsers and poll web sites on command to measure the download 
performance of the web page from that selected location. 

The DCA software includes a browser component configured to operate current 

15 HTTP versions such as HTTP 1.0 and HTTP 1.1. Browsers of the type suitable for this 
purpose can include Internet Explorer by Microsoft of Redmond, Washington or 
Navigator by Netscape Communications Corp. of Sunnyvale, California. Preferably, the 
browser component of the DCA is configured to realistically emulate a web page 
download from the commercially available browser configurations available. Thus, as 

20 browser versions are improved the browser component of the DCA would be updated. 
When given a URL as input, the browser emulator component is responsible for looking 
up a target Web server (e.g. using the Domain Name System), connecting to a Web 
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server, requesting content objects using HTTP, and then receiving server replies and the 
actual content objects. The browser component is multi-threaded to allow for the 
download of multiple files at the same time in the same manner that conamercially 
available browsers download files. In addition, the browser component parses various 
5 content objects such as HTML and Java scripts in order to determine all of the file 
components that need to be downloaded to completely build a target web page. The 
browser component further operates with a browser cache so that it will not perform 
duplicate or redundant downloads. The browser is further configurable according the 
currently available configuration options of conmiercial browsers to allow for the DCA to 

10 accurately emulate the download performance of a user operating a specific commercial 
browser. In this way a DCA can test various browser configuration and commercial 
versions to provide unique performance measurement corresponding to actual users. The 
DCA also includes a dynamic server component that controls the browser emulator 
component and listens for requests to download Web pages. When a request to measure a 

15 Web page download arrives, the dynamic server allocates a browser emulator to 
download the page and measure the web page download time. As the download is 
completed, the dynamic server sends the associated measurement data back to the client 
that requested the download measurement. The client in this case is either the user 
interface component or an intermediary acting on behalf of that component. 

20 

In one embodiment of the present invention (fig. 8) the process by which web 
page object-level data is collected and measured across the Internet 120 utiHzes a number 
of data collection agents (DCAs) 122 sitting out in different locations across the Internet 
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that report back information to the user through the user interface software 124. The 
location of these DC As are placed strategically to provide information regarding 
performance at critical backbone communication links, between various peering links, 
between commercial network service providers, and at selected ISP locations. Preferably, 
5 DCAs would be located at all points along the Internet where there are changes in the 
network topology created by either changes in geography, traffic volume, hardware, 
software or network operators. These agents are connected to the Internet via different 
backbone providers and in different physical locations. A presently preferred DCA is 
composed of standard computer (such as a SUN Ultra 20) running browser emulation and 

10 measurement software. The DCA is connected to the Internet using a dedicated Tl line 
(running at 1.54 Mbps) or burstable bandwidth (running at greater than Tl speed) 
provided by a 3'^ party. The measurement and browser emulation software is functionally 
equivalent to a piece of software commonly called a "Web Browser". The measurement 
software (referred to hereafter as SM-Browser) uses the standard HTTP protocol to 

15 interact with a web server. A URL (which defines which web page the SM-Browser will 
analyze) is configured into the system. At regular intervals (or on demand as well) this 
URL is downloaded and measured. Downloaded refers to the process of requesting data 
be transferred from one source to another. In the case of SM-Browser, the requester is 
SM-Browser, the suppher of data is the targeted web server. The content of a downloaded 

20 URL may refer to more objects on a page (e.g. graphics, separate page frames, 

redirections, etc.). The SM-Browser, using the HTTP protocol, downloads the first object 
returned by the web server for the configured URL. The content returned is parsed apart 
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following the industry standard HTML (HyperText Markup Language) formatting 
specification. This parsing recognizes other objects referenced in the content returned that 
need to be retrieved as well. The SM-Browser then retrieves all other objects referenced 
by the content (and any further content retrieved), thus retrieving all the objects (or 
5 components) of a "page". The retrieval of the multiple objects that may constitute a 
"complete" page occurs in parallel. While the retrieval of the object occurs, the SM- 
Browser measures performance times by timing parts of the retrieval process. These parts 
include, but are not Umited to, resolution of DNS (or the conversion of a textual computer 
name on the internet into an IP address which is used by the computers to communicate 

10 with each other), TCP/IP network connection time, HTTP request acceptance time, time 
for the web server to respond with content, time to download the complete content/object, 
and time to disconnect the TCP/IP connection. The measurements also capture non- 
speed based information such as errors that might have occurred during the download, 
source of the content by IP address, and type of content that an object represents (e.g. 

15 image, text, audio file). 

These measurements are made during the retrieval of each object that is part of the 
targeted URL (or page). These measurements are maintained in memory and then stored 
in a log file for further processing. In the case of on-demand measurement, these log file 
entries full of measurements are returned to the visualization application instantly. The 

20 application parses the log file lines apart and visually represents each measurement as it 
occurred chronologically for each object that was retrieved. Thus each measurement for 
each object can be visualized as a separate segment of the retrieval of an object in the 
visualization application. 
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Performance measurements use automated Web site visits to generate data for 
objective analysis of site performance. The objective performance measurements allow a 
user to isolate and troubleshoot sources of performance problems from different locations 
throughout the Internet. Armed with actionable data categorized by component (e.g. 
5 network connection, hardware, ISP), managers can prioritize problems and select from 
available options, the most cost-effective solution. 

Backbone Specific Agents (BSAs) and Multi-housed Agents (MHAs) are used to 
distinguish between peering issues and geographic issues. Peering agreements between 
network service providers can determine the conmiunication speed and clarity with which 
10 data may be transmitted between two network service providers. Data transmitted 
•L; between two geographically distant sites connected by a peering agreement may be 

transmitted more rapidly than between two geographically proximate sites. Thus, a Web 
S site in Seattle may perform better for a customer in New York than for one in Denver, 

y This is because of the way the underiying network providers work with each other. When 

15 DC As are placed throughout the Intemet, their measurements allows for an objective 
□ examination of such network configurations in relation delivering web pages to end users 

and provides data to improve performance from every location. 

Measurements can occur systematically from multiple geographic and network 
locations, representing diverse user populations and network backbones/ISPs. The Web 
20 Performance Timeline feature provides in-depth performance data on concurrent Web 
object download events. This feature provides Web site managers with an unprecedented 
level of performance information reporting. The data captured and presented can be 
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combined to provide a variety functional tools to the user. Those skilled in the art will 
appreciate by polling several DCA under different browser configurations that such 
functional tools can include: 

• means for determining the time for a customer to view a Web page; 

5 • means for measuring a web site's performance vary by regional location or the 

network connectivity of the end-user; 

• means for determining a customer's experience by time of day and day of the 
week; 

• means for determining the origination of Internet-related performance problems; 
10 • means for comparing download performance compare to industry standards or 

competitive Web sites; 

• means for monitoring download performance changes since the last 
hardware/software/design investment to the web site; 

• means for monitoring access refusals due to traffic overload; 
15 • means for monitoring the rate that incomplete pages served; 

• means for monitoring performance over time to obtain performance trends as to 
whether web site access is getting better or worse over time; 

• means for monitoring performance in relation to performance thresholds such as 
corporate goals and acceptable levels; 

20 • means for determining web site performance improvements; and 

• means for determining vendor weaknesses contributing to poor Web site 
performance. 
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It will be appreciated with the advent of wireless communication devices capable 
of downloading and viewing remotely readable information from the Internet such as 
personal data assistants (PDAs), beepers and wireless messaging services, and cellular 
telephones that the DCA browser emulation software can include emulations capable of 
downloading documents and other information tailored to wireless devices. Thus, 
allowing for an objective of examination of the download and review of wireless 
information as well. 

Numerous modifications and altemative embodiments of the invention will be 
apparent to those skilled in the art in view of the foregoing description. Accordingly, this 
description is to be construed as illustrative only and is for the purpose of teaching those 
skilled in the art the best mode of carrying out the invention. Details of the structure may 
be varied substantially without departing from the spirit of the invention and the 
exclusive use of all modifications which come within the scope of the appended claim is 
reserved. 
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A method for internet performance monitoring and analysis comprising the 
steps of: 

collecting web page object-level data; and 
measuring access to web page objects. 

2. The method as recited in claim 1 wherein the step of measuring further 
captures non-speed based information including errors during download, source of 
content by IP address, and type of content that an object represents. 

3. The method as recited in claim 1 wherein the step of collecting further 
comprises collecting web page object-level data with at least one data collection 
agent. 

4. The method as recited in claim 1 wherein the step of measuring utilizes 
standard HTTP protocol to interact with a web server. 

5. The method as recited in claim 1 further comprising the step of requesting 
data be transferred from one source to another. 

6. The method as recited in claim 5 wherein the step of requesting occurs 
automatically. 
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7. The method as recited in claim 1 wherein the step of measuring further 
comprises parsing and recognizing other objects referenced in a content returned 
that need to be retrieved as well. 

8. The method as recited in claim 7 further comprising the step of retrieving 
the other objects referenced in the content. 


^ A system for performance monitoring and analysis through a computer 
network comprising: 

at least one agent connected to said computer network and under the 


collect the object-level data and 

measure the access parameters while the collection of the object- 
level data occurs; and 

a user interface component to receive measurement data from said agent. 


A system for performance monitoring and analysis of web pages from a 
web server through a global computer network comprising: 

a plurality of agents located at distributed points throughout a global 
computer network; 



control of software to: 
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each of said agents being under the control of software to collect the object 
level data and to measure access parameters while the collection of the object- 
level data occurs; and 

a monitoring component to receive measurement data from said agent. 



The system for performance monitoring and analysis through a global 
computer network including means for determining the time for a customer to 
view a Web page. 

The system for performance monitoring and analysis through a global 
computer network including means for measuring variations a web site's 
performance by regional location or the network connectivity of the end-user. 

The system for performance monitoring and analysis through a global 
computer network including means for determining a customer's experience by 
time of day and day of the week. 

J^, The system for performance monitoring and analysis through a global 
computer network including means for determining the origination of Internet- 
related performance problems. 
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The system for performance monitoring and analysis through a global 
computer network including means for comparing download performance 
compared to industry standards or competitive Web sites. 

The system for performance monitoring and analysis through a global 
computer network including means for monitoring download performance 
changes since the last hardware/software/design investment to the web site. 

J^, The system for performance monitoring and analysis through a global 
computer network including means for monitoring access refusals due to traffic 
overload. 

The system for performance monitoring and analysis through a global 
computer network including means for monitoring the rate that incomplete pages 
served. 

^ The system for performance monitoring and analysis through a global 
computer network including means for monitoring performance over time to 
obtain performance trends as to whether web site access is getting better or worse 
over time. 
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The system for performance monitoring and analysis through a global 
computer network including means for monitoring performance in relation to 
performance thresholds such as corporate goals and acceptable levels. 

The system for performance monitoring and analysis through a global 
computer network including means for determining web site performance 
improvements. 

The system for performance monitoring and analysis through a global 
computer network including means for determining vendor weaknesses 
contributing to poor Web site performance. 
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ABSTRACT 

A system for internet performance monitoring and analysis includes at least one 
agent connected to a computer network and adapted to collect the object-level data and to 
measure the access parameters while the collection of the object-level data occurs. 
Appreciably, the system may a plurality of agents located at distributed points throughout 
a global computer network. Each agent is adapted to collect the object level data and to 
measure access parameters while the collection of the object-level data occurs. The 
collective measurements when taken at different points throughout the network provide 
functional tools to assess the distribution of the remotely readable documents. 
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